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A method of selecting operational parameters in a 



communication network 



Technical Field 
5 The invention relates to a method of selecting 

operational parameters in a communication network, 
particular^ it relates to a method of selecting 
operational parameters in a communication network, 
method utilising a simulated annealing process. 

10 

Background 

Communication networks, for example mobile communication 
networks, require optimisation procedures that help to 

15 balance competing performance indicators such as 

coverage, capacity and quality of service. Typically 
these optimisations must be performed as a function of 
network parameters such as, in the case of mobile 
communication networks, frequency allocation, pilot power 

20 and antenna orientation (e.g. azimuth and downtilt) . 

Traditional optimisation algorithms typically build a 
system model and then search the parameter space to 
identify an optimal value of a performance metric 
25 function related to an objective, such as a performance 
indicator. Search methods for exploring large parameter 
spaces include genetic algorithms and simulated annealing 
processes : 

30 Genetic algorithms (GAs) analogise evolution under an 

environmental constraint. GAs splice possible parameter 
representations together and assess the fitness of the 
resulting metric against an objective. The parameters for 
the more favourable results are kept from a range of 
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splicings and the process is then iterated, optionally 
with additional random permutations. However, there is no 
guarantee of convergence on a globally optimal result and 
relatively little is known about such algorithms' 
5 behaviour. 

Simulated annealing (SA) processes analogise the 
crystallisation of a fluid into a minimum-energy state. 
In SAs f the parameter values are perturbed in relation to 

10 a notional temperature. If the resultant change in energy 
(the chosen metric ) is negative, the perturbation is 
kept. If the resulting change in energy is positive, the 
perturbation is kept according to a temperature -dependent 
probability. Thus at high temperatures the system is able 

15 to climb out of local energy minima and explore the 

parameter space. As the ^temperature' is slowly reduced, 
the search of the parameter space becomes increasingly 
localised and conservative, ideally centring on the 
global minimum. SAs have the benefit that for 

20 sufficiently slow reductions in temperature, a global 

minimum is guaranteed as shown in S. Geman and D. Geman, 
""Stochastic relaxation, Gibbs distributions, and the 
Bayesian restoration of images,'' IEEE Trans. Pattern 
Analysis and Machine Intelligence, vol. 6, pp. 721-741, 

25 1984. 

In order to determine an optimum balance between several 
objectives such as coverage, capacity and quality of 
service, a single, compound objective metric function 
30 must be derived for use in both the optimisation 
processes described above. 
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However, the construction of a single metric function 
incorporates inherent trade-offs and assumptions within 
it that it would be preferable to consider explicitly: 

5 It may not be sensible to strive for a single optimum 
trade-off between key objectives, because the relative 
importance of these objectives may vary with 
circumstance. For example, variations in cell density 
over a network may alter the best trade-off between 
10 coverage and soft hand-over frequency. 

Thus a need exists for a method of selecting operational 
parameters in a communication network that allows the 
various trade-offs between objectives to be considered 
15 explicitly. 

The purpose of the present invention is to address the 
above problem. 

20 Summary of the Invention 

The present invention provides a method of selecting 
operational parameters of a communication network. The 
method is characterised by searching the operational 

25 parameter space using a multiple objective simulated 
annealing (MOSA) process, wherein the objectives are 
based upon performance indicators (Pis) of the 
communication network. Moreover, the MOSA process 
generates an archive of estimated values of a Pareto 

30 front and employs a dominance-based energy function. 

The present invention provides the benefit of enabling 
assessment of different estimated optimal trade-offs 
between multiple objectives. 
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In a first aspect, the present invention provides a 
method of selecting operational parameters of a 
communication network, as claimed in claim 1. 

5 

Further features of the present invention are as defined 
in the dependent claims. 

Embodiments of the present invention will now be 
10 described by way of example with reference to the 
accompanying drawings, in which: 

Brief description of the drawings 

15 FIG. 1 illustrates an energy evaluation of two solutions 
with respect to a Pareto front, in accordance with an 
embodiment of the present invention. 

FIG. 2 illustrates an attainment surface derived from 
20 archived estimates of a Pareto front, in accordance with 
an embodiment of the present invention. 

FIG, 3 similarly illustrates an attainment surface 
derived from archived estimates of a Pareto front, in 
25 accordance with an embodiment of the present invention. 



30 Detailed description 

A method of selecting operational parameters of a 
communication network is disclosed. In the following 
description, a number of specific details are presented 
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in order to provide a thorough understanding of the 
present invention. It will be obvious, however, to a 
person skilled in the art when these specific details 
need not be employed to practice the present invention. 
5 In other instances, well known methods, procedures and 
components have not been described in detail in order to 
avoid unnecessarily obscuring the present invention. 

Simulated annealing is a popular method of solving single 
10 objective optimisation problems where only one dependent 
variable of the system is under consideration. 

However in the field of communications it is clear that a 
number of variables may need to be optimised in the 
15 setting up or running of a communication system. 

Whilst some genetic algorithms exist for multiple 
objective problems (e.g. see C.A.C Coello, ""A 
Comprehensive Survey of Evolutionary-Based Multiobj ective 
20 Optimization Techniques, Knowledge and Information 

Systems. An International Journal, vol. 1, no. 3, pp. 
269-308, 1999) , methods for simulated annealing typically 
rely on combining multiple objectives into a single 
ob j ective function . 

25 

For example, see P. Engrand, ^^A multi-objective approach 
based on simulated annealing and its application to 
nuclear fuel management," in 5th International Conference 
on Nuclear Engineering, Nice, France, 1997, pp. 416-423, 
30 P. Czyzak and A. Jaszkiewicz, ^''Pareto simulated annealing 
- a metaheuristic technique for multiple-objective 
combinatorial optimization, " Journal of Multi-Criteria 
Decision Analysis, vol. 7, pp. 34-47, 1998, or A. 
Suppapitnarm, K. A. Sef fen, G .T . Parks, and P.J. Clarkson, 
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^^A simulated annealing algorithm for multiobj ective 
optimization," Engineering Optimization, vol. 33, pp. 59- 
85, 2000. 

5 However, these methods suffer from the problems of 

inherent trade-offs and assumptions noted previously, and 
have problems in converging and/or in properly exploring 
the possible parameter space. 

10 The present invention provides an alternative multiple- 
objective simulated annealing (MOSA) process, using a 
dominance based energy function rather than a combined 
single ob j ective function . To explain the proposed 
process, dominance and multiple objective simulated 

15 annealing are now discussed in more detail: 

A. Dominance and Pareto Qptimality 

In a multi-objective optimisation one attempts to 
20 simultaneously maximise or minimise D objectives, y^; 

which are functions of P variable parameters or decision 
variables, x = (xi^ x^, . . . , Xp ^ : 

Yi = f (x) ; i = 1, ,D 
25 (1) 

Without loss of generality, assume that the objectives 
are to be minimised. The multi-objective optimisation 
problem may then be expressed as: 

30 

Minimise y = f(x) = (fi(x), ... , foix)) 
(2) 

The notion of dominance is generally used to compare two 
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solutions a and b: If f(a) is no worse for all objectives 
than f(b) and wholly better for at least one objective^ 
it is said that a dominates b, denoted a-<b. Thus a-<b if: 

5 fi(a) < fi(b) Vi = 1, ... ,D and 

fi(a) < fi(b) for at least one i. 

(3) 

Clearly the dominates relation is not a total order and 
10 two 

solutions are mutually non-dominating if neither 
dominates 

the other. A set F of solutions is said to be a non- 
dominating set if no element of the set dominates any 
15 other: 

aAb V a,b s F 

(4) 

A solution is said to be globally non-dominated, or 
20 Pareto optimal, if no other feasible solution dominates 
it. The set of all Pareto-optimal solutions is known as 
the Pareto-optimal front or Pareto set, P. 

Solutions in the Pareto set thus represent the possible 
25 optimal trade-offs between competing objectives. 

In the context of a communication system where the 
objectives are related to performance indicators, and the 
solutions are based upon values of network parameters, 
30 this clearly provides a mapping between parameter values 
and a plurality of trade-off positions that may be 
selected. 
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The selection process may then be conducted either by 
considering the importance of the different objectives in 
a given situation. 

5 It should be noted that in practice^ the non-dominated 
set produced by one or more runs of such a MOSA would in 
all likelihood only be an estimate of the true Pare to 
front. Consequently the set produced by such a process is 
referred to hereinafter as the archive of the estimated 
10 Pareto front, denoted F. 

B. Simulated Annealing 

As noted previously, simulated annealing is the 
15 computational analogue of slowly cooling a metal so that 
it adopts a low-energy, crystalline state , In such an 
analogy, at high temperatures particles are free to move 
fluidly, but as the temperature is lowered they are 
increasingly 

20 confined due to the high energy cost of movement. 

It is physically appealing to call the function to be 
minimised the energy, E (x) , of the solution (state) x and 
to introduce a parameter T, the computational temperature 

25 which is lowered throughout the simulation according to 
an annealing schedule. At each T the SA process aims to 
draw samples from the equilibrium distribution tttIx) oc 
exp{-E (x) /T} . As T —> 0 the probability mass of ttt is 
increasingly concentrated in the region of the global 

30 minimum of E, so that any sample from ttt will most 
probably lie at the minimum of E. 



Sampling from the equilibrium distribution is usually 
achieved by Metropolis-Hastings sampling, which involves 
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making proposals that are accepted with probability 



A = min(l, exp{- SE{x\ x) / t}) 
(5) 

5 

where 

SE(x, x) = E(x) - E(x) 

(6) 

10 

Thus, when the notional temperature T is high, 
perturbations from solution x to proposed solution x' 

that increase the energy, i.e. 5E(x',x)>0, are likely to 
be accepted. Note that peturbations from x to x' that 
15 decrease the energy are always accepted by the 
formulation of equation (5) . 

Thus when the temperature is high, samples from the 
equilibrium distribution can easily explore the state 
20 space as the ability to accept higher-energy solutions 
enables escape from local minima. 

As T decreases however, only perturbations leading to 
smaller increases in E are accepted. 

25 

Consequently, only a limited exploration of the state 
space becomes possible as the system settles, ideally, on 
the global minimum. 

30 The SA process described is summarised in Table 1 below. 
During K epochs, the computational temperature is fixed 
at Tk, and Lk samples are drawn from before the 

temperature is lowered in the next epoch. Candidate 
solutions, x', are drawn from a proposal density (line 

9 
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3) . A candidate solution x' is then accepted with a 
probability as given by equation (5) , as shown in lines 
4-8. 

5 Preferably^ one obtains candidates x' by perturbing each 
element of x singly, drawing an additative perturbations 

from a Laplacian distribution p(e) oc e"'"^^' that has tails 
which decay relatively slowly, thus ensuring that there 
is a high probability of exploring regions distant from 
10 the current solutions. However it will be clear to a 

person skilled in the art that alternative perturbation 
functions may be used. 



Table 1. 


Simulated Annealing Process 


Inputs : 






Sequence of epoch durations 




Sequence temperatures, T^+i < 


X 


Initial feasible solution 


steps : 




1: for k 


:= 1,...,K 


2: for 


i := l,...,Lk 


3: 


x' := perturb () 


4: 


5E := E (x' ) - E (x) 


5: 


u := rand(0, 1) 


6: 


if u < min(l, exp(-dE/Tk)) 


7: 


X := x' 


8: 


end 


9 : end 




lOrend 
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As noted previously^ traditional attempts to incorporate 
multiple objectives within a simulated annealing process 
5 have concentrated on combining the objectives into a 
weighted sum: 

D 

E{x) = J] w,f,{x) 

2 = 1 

(7) 

10 

The composite objective is then used as the energy to be 
minimised. Such an approach results in convergence to 
points on the Pareto front where the objectives have 

ratios given by (where such points exist) , and so the 

15 inherent trade-offs and assumptions built into the 

selection of the weights wi are expressed in the limited 
way that the parameter space is searched. 

Consequently, the inventors of the present invention 
20 propose an alternative energy function, based not on a 

composite objective, but on dominance between objectives: 

In single objective optimisation problems the energy E(x) 
is an absolute measure of the quality of any solution x 
25 and the optimum is that solution x with the lowest 

energy. However, in the multi-objective case optimum 
solutions are only meaningfully defined in relation to 
each other: the Pareto front is the set of solutions that 
dominate all other solutions. 

30 

The inventors have appreciated that one can compare the 
relative quality of x and x' with the dominance relation, 

11 
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but note that it gives essentially only three values of 
quality - better, worse, or equal - in contrast to 
the energy difference in uni-ob j ective problems which 
usually gives a continuum. 

However, the inventors have further appreciated that if 
the true Pareto front P were available, one could define 
an energy of x as the measure of the front that dominates 
x: 

Let Px be the portion of P that dominates x 

P^ = {y s P \ y x} 
(8) 

Then define 



E(x) = ju (PJ 
(9) 



where // is a measure defined on P. For simplicity but 

without loss of generality, one may take ju(Px) to be the 
cardinality of Px when P^ is finite. If P is a continuous 
set, we can take jU to be the Lebesgue measure 
25 (informally, the length, area or volume for 2, 3 or 4 
objectives) . 

As illustrated in Fig. 1, this energy E(x) has the 
desired properties: if x 6^ P then E(x) = 0, and solutions 
30 more distant from the Pareto front 100 are in general 
dominated by a greater proportion of P and so have a 
higher energy; in Fig. 1 the solution 101 marked by an 
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open circle has a greater energy than the solution 102 
one marked by a filled circle. 

Clearly, this formulation of energy E (x) does not rely on 
5 an a priori weighting of the objectives. Consequently the 
disadvantages of a composite ob j ective energy function 
are avoided and the guarantee of convergence for uni- 
objective SA continues to hold. 

More significantly, because all solutions lying on the 
10 Pareto front have equal minimum energy, one may expect 
that a simulated annealer using the dominance energy 
measure will, on reaching the Pareto front, perform a 
random walk exploration of it . This enables a thorough 
exploration of the optimal trade-offs possible between 
15 the objectives. 

As noted previously, in practice the true Pareto front P 
is unavailable, and so in an embodiment of the present 
invention, an archive of estimated values of the Pareto 
20 front, F, is used instead. 

Noting that F is the set of mutually non-dominating 
solutions found thus far during the annealing process, 

then denote F as the union of F with the current solution 
25 X and the proposed perturbation to that solution x' . 

In a similar fashion to equation (8) , let F^ be the 

elements of F that dominate x: 

30 F^ = (y € F \ y < X} 

(10) 



so that an energy difference between the current and 
proposed solutions is obtained as 

13 
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SEix, x') = ^ (\f^\ - \f^.\) 

(11) 

5 Where division by |f| ensures that 5e < 1, and mutes the 

impact of changes to the number of solutions in the set F 
on the value of Se. 

The inclusion of the current solution x and proposed 

perturbation to the solution in F ensures that 

10 5E(x,x^)<0 if x^<x. This ensures that proposed solutions 
that move the estimated Pareto front towards the true 
Pareto front are always accepted. 

As noted previously, this new dominance-based energy 
15 measure provides a single energy function that encourages 
convergence towards and subsequent coverage of the Pareto 
front of a multi-objective system, without any 
modification to the simulated annealing process other 
than the archival of Pareto-front estimates F. 

20 

However, when the archive set F is initially small, the 
energy resolution of SE is correspondingly coarse and may 
impact upon the operation of the acceptance criterion 
described in equation (5) . A low resolution of 
25 probability additionally discriminates against higher 
energy perturbations at low temperatures and is 
preferably avoided. 

Consequently, in an enhanced embodiment of the present 
30 invention, the population of set F is boosted by 
interpolated values . 

14 
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Preferably^ the interpolated points satisfy three 
criteria : 



i. The interpolated points must be sufficiently close 
5 to the current estimation of the Pareto front that 

they can affect the energy of new solutions 
generated near the current estimated Pareto front; 

ii . The interpolated points must be evenly distributed 
across the currently estimated Pareto front so as 

10 to not bias the MOSA process away from poorly 

populated regions of the front , 

iii. The interpolated points must not dominate any 
proposal that is not dominated by any member of F, 
so that solutions that may potentially join F are 

15 not incorrectly discarded. Consequently an 

interpolated point must be dominated by at least 
one current member of F. 



Such an interpolation surface exists in the form of an 
20 attainment surface Sf. As can be seen in Figure 2, this 
attainment surface is a conservative interpolation 
describing the boundary of the region in objective space 
U 220 that is dominated by at least one element of F. In 
Figure 2, this boundary 210 is drawn for a set F 
25 comprising three two-dimensional elements 201, 202 and 
203. 

Formally, if u, v s then u properly dominates v 
(denoted u < v) if u±<Vi Vi=l,...,D. Then if 

30 

F = (y \ u < y for some u s Fj 
(12) 

and U = {y \ u < y for some u e Fj 

(13) 
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the attainment surface Sf = F/U. 

The attainment surface may be sampled as summarised in 
Table 2 below, in which a point is sampled from a uniform 
5 distribution on the axis-parallel hyper-rectangle 

bounding F and then one coordinate is restricted so that 
the point is dominated by an element of F. 
Determining whether an element of F dominates v on line 8 
of the process listed in Table 2 may be efficiently 

10 implemented using a binary searches of the lists Li, in 

which case the problem is of order 0 (\ F\ log (\ F\ ) ) for the 
generation of each sample. Fig, 3 illustrates the 
resulting sampled attainment surface for a set F 
comprising ten 3-dimensional points, with 10,000 samples 

15 shown for visualisation purposes only. 

Table 2. Sampling a point from the attainment surface 
Inputs : 

{L.]^^^ Elements of F, sorted by increasing coordinate 

20 Generate a random point, v: 
1 : for i := 1, ... , D 
2: Vi := rand (min (Li) , max (Li)) 
3 : end 

4 : d := randint (1, D) 

25 

Find smallest Vd such that v is dominated by a y g F: 
5: for i = 1, ... , I F| 
6: u = Ld,i 
7: Vd := Ud 
30 8: if F -< V 

9: return v 

10: end 
11: end 

16 
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D. Process control 



In common with other SA processes^ the performance of the 
MOSA process described herein is influenced by the 
5 selection of the initial temperature, annealing schedule 
and perturbation size. Options for these aspects of the 
MOSA process are presented below. 

If the initial temperature of the system is set too high, 
10 all proposed solutions will be accepted, irrespective of 
their relative energies, whereas if it is set too low 
then proposals with a higher energy than the current 
solution will not be accepted, turning the process into a 
greedy search. 

15 

Thus a reasonable initial temperature to set achieves an 
initial acceptance rate of approximately 50% on 
derogatory (increased energy) proposals. This initial 
temperature. To; can be easily calculated by using a short 

20 ^burn-in' period during which time all solutions are 

accepted, and then setting the temperature equal to the 
average positive change of energy divided by In (2) . It 
will be clear to a person skilled in the art that 
alternative strategies for estimating an initial 

25 temperature exist, such as initially increasing To until 
an roughly 50% of accepted proposals are derogatory. 

A reasonable annealing schedule adjusts the temperate 
according to T^ = 0^To, for the Jc^^ epoch, where P is less 
30 than 1. 

It will be clear to a person skilled in the art that 
alternative initial temperatures and annealing schedules 
may be employed. 

17 
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In the context of the present invention, perturbation 
size may advantageously be distinguished for those 
solutions approaching the estimated Pare to front 
5 (location perturbations) , versus those solutions actually 
traversing the estimated Pareto front (transversal 
perturbations) . 

In an embodiment of the present invention, the parameter 
10 to be perturbed is chosen at random, and as noted 

previously is perturbed with a random variable drawn from 

a laplacian distribution p{e) qc e"'"^"^' , where the scaling 

factor a alters the magnitude of permutation. By 
maintaining two sets of scaling factors, two perturbation 
15 sizes may be distinguished. 

A scaling factor is maintained for each dimension of 
parameter space for each of location perturbations and 
traversal perturbations, and these are adjusted 
20 independently. When perturbing a solution, it may be 
chosen 

randomly with equal probability whether the location 
scaling set or the traversal scaling set will be used. 
This reduces the possibility of traversing within a local 
25 minima if the estimated Pareto front has not yet 
converged near the true Pareto front. 

The scalings may be initially set large enough to sample 
from the entire feasible space. The scalings are then 
30 adjusted throughout the optimisation, whenever a suitably 
large statistic set is available to reliably calculate an 
appropriate scaling factor. 

18 
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In an embodiment of the present invention, traversal 
scaling is recalculated for a particular decision 
variable, Xj , whenever approximately 50 traversal 
perturbations have been made to Xj since the last 
5 rescaling . In order to ensure wide coverage of the 

estimated front, it is desirable to maximise the distance 
(in objective space) covered by the traversals to ensure 
the entire front is evenly covered. 

10 Proposals are preferably generated on approximately the 
scale that has previously been successful in generating 
wide-ranging traversals. To achieve this, the 
perturbations are sorted by absolute size of perturbation 
in parameter space , and then trisected in order, giving 

15 three groups, one of the smallest third of perturbations, 
the largest third of perturbations, and the remaining 
perturbations . 

For each group the mean traversal size caused by the 
20 perturbations is calculated. The traversal size is 

measured as the Euclidean distance travelled in objective 
space when the current solution and the proposed solution 
are mutually non-dominating. The traversal perturbation 
scaling for decision variable Xj is then set to the 
25 average perturbation of the group that generated the 
largest average traversal. 

In an embodiment of the present invention, location 
scaling is adjusted in an attempt to maintain the 
30 acceptance rate for proposed perturbations that have a 
higher energy than x to approximately one third, so that 
exploratory proposals are made and accepted at all 
temperatures . 

19 
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The location perturbation scaling is typically 
recalculated for each parameter for which 20 proposals 
with energies greater than the current solution have been 
generated^ after which the count is reset. Location 
perturbation rescaling may be omitted in two cases : 

i. when the archive of the estimated Pareto front F 
has fewer than 10 members ; and 

ii . when the combined size of F augmented by the 
samples from the attainment surface when 
multiplied by the temperature does not exceed 1 . 

The latter accommodates that in attempting to keep the 
acceptance rate of derogatory moves to approximately a 
third, then when this value is too small it becomes 
impossible to generate such a scaling and so the scalings 
are kept at the most recent valid value. 

Only counting moves generated from perturbations to a 
particular dimension of parameter space, the acceptance 
rate of derogatory moves a is the fraction of proposals 

to a greater energy which are accepted. If a denotes the 
location perturbation scaling for a particular dimension, 
the new a is set as: 

J cr(l + 2(a - 0 . 4) / 0 . 6) if a > 0 . 4 
^ [o- / (1 + 2(0 . 3 - a) / 0 . 3 if a < 0.3 

(14) 

This update scheme exploits the tendency for smaller 
perturbations in parameter space to generate small 
changes in objective space, resulting in smaller changes 
in energy. 

E. Objectives and trade-off selection in communication 
networks 
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In an embodiment of the present invention, the above 
process may be used to consider trade-offs between 
objectives falling within any or all of the following 
categories; 

5 

i. Capacity; 

ii . Coverage; and 

iii. Quality of service. 

10 Capacity may comprise one or more objectives, such as 
mean traffic level, or voice and data capacities. 

Coverage may comprise one or more objectives, such as the 
range within a cell, mean traffic power per user, the 
15 percentage of users whose devices do not receive a pilot 
above a given threshold signal strength, or an out-of- 
cell to in-cell interference ratio. 

Quality of service may comprise one or more objectives, 
20 such as the average ratio between the mobile Eb/No 
(energy per bit noise floor) achieved and an Eb/No 
target, the mean data rate, or average soft handover 
factors . 

25 It will be clear to a person skilled in the art that 
other objectives may be considered in different 
communication networks . 

The estimated Pareto front generated by the process 
30 described herein will then represent possible estimated 
optimal trade-offs between the selected objectives. By 
applying different notional costs to different objectives 
and/or parameters for a given set of circumstances, the 
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cheapest trade-off may then be selected as the best for 
those circumstances . 

Obtaining different trade-offs for different scenarios 
then simply requires alteration to the costing. 

The operational parameters underlying the best solution 
may then be applied to the communication network. 

Whilst the proposed method is applicable to any 
communication network in which two or more objectives by 
traded off each other by the selection of operational 
network parameters, it is envisaged as being of 
particular use in the field of mobile communication 
networks utilising GSM, CDMA, UMTS, GPRS, IP, or general 
radio access networking technology. 

It will be understood that the method of selecting 
operational parameters of a communication network as 
described above, provides at least one or more of the 
following advantages: 

i. Estimates are obtained of trade-offs between 
multiple objectives of a communication network; 

ii . Knowledge of the relative weights of the 
objectives need not be known prior to the MOSA 
process; 

iii. Objectives are not aggregated into a single energy 
metric for the parameter search, which would bias 
and/or limit the search process; 

iv. Network designers can evaluate a wide set of 
possible trade-off solutions; and 
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V. The posited set of trade-offs may be investigated 
and selected between by costing different 
scenarios . 
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